Information processing system

ABSTRACT

An information processing system includes a plurality of imaging devices, and an information processing device. The information processing device includes a receiving unit configured to receive work process data indicating items of multiple work processes; a first image of a first form including first job ID information; and information indicating that multiple pieces are obtained from a first deliverable corresponding to the first form, in a first work process from among the multiple work processes. The information processing device includes a job-ID generating unit configured to generate a second job ID in which distinguishing information is added to a first job ID. The information processing device includes a color-code image generating unit configured to generate second color code data based on the second job ID.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation application and claimspriority under 35 U.S.C. § 120 to U.S. patent application Ser. No.16/816,505 filed Mar. 12, 2020, which claims priority to Japanese PatentApplication Nos. 2019-49133, filed Mar. 15, 2019, and 2020-40234, filedMar. 9, 2020. The contents of the applications are incorporated hereinby reference in their entirety.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present disclosure relates to an information processing system.

2. Description of the Related Art

Barcodes or the like printed on work instructions have been used tomanage progress of jobs associated with a plurality of work processes.

A system has been known to read RFID (Radio Frequency Identification)tags attached to workers and objects (e.g., in a plant, material,in-process products, products, or the like) to manage a work time of agiven worker and a work flow (entry to a workplace and exit from theworkplace) of a given object (see, e.g., Japanese Unexamined PatentApplication Publication No. 2005-100298 which is hereinafter referred toas Patent Document 1).

SUMMARY

According to one aspect of the present disclosure, an informationprocessing system is provided. The information processing systemincludes:

a plurality of imaging devices; and

an information processing device including:

-   -   a receiving unit configured to receive work process data        indicating items of multiple work processes; a first image of a        first form including first job ID information; and information        indicating that multiple pieces are obtained from a first        deliverable corresponding to the first form, in a first work        process from among the multiple work processes;    -   a job-ID generating unit configured to generate a second job ID        in which distinguishing information is added to a first job ID;    -   a color-code image generating unit configured to generate second        color code data based on the second job ID;    -   a storage unit configured to store the second color code data,        the first job ID, the second job ID, and the work process data        to be associated with each other;    -   an image-data generating unit configured to generate second        image data based on the second color code data and the second        job ID, the second image data indicating a second form different        from the first form;    -   an image obtaining unit configured to obtain image data and        identification information of a given imaging device from among        the plurality of imaging devices, the image data being generated        based on the generated second image data of the second form that        the given imaging device photographs, the second form being        disposed on a recording medium;    -   a color-code extracting unit configured to extract the second        color code data from the image data obtained by the image        obtaining unit; and    -   a specifying unit configured to specify a status of a given work        process from among the multiple work processes, based on the        identification information; the second color code data extracted        by the color-code extracting unit; the second color code data        stored in the storage unit; the second job ID stored in the        storage unit; and the work process data.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram illustrating an example of a configuration of a jobmanagement system according to one or more embodiments;

FIG. 2 is a diagram illustrating an example of work instructions used inthe job management system according to one or more embodiments;

FIG. 3 is a diagram illustrating an example of a hardware configurationof a computer;

FIG. 4 is a diagram illustrating an example of a functionalconfiguration of the job management system;

FIG. 5 is a diagram illustrating an example of a table in a storage unitthat stores associated various pieces of information;

FIG. 6 is a diagram illustrating an example of a table in the storageunit that stores pieces of identification information of imagingdevices, as examples of cameras; and work process statuses to beassociated with each other;

FIG. 7 is a diagram illustrating an example of work processes in aprinting plant;

FIG. 8 is a flowchart illustrating an example of a process of creating asecond form based on a first job ID;

FIG. 9 is a flowchart illustrating an example of a process of generatinga color code image;

FIG. 10 is a diagram illustrating an example of a encoding rule for anumber expressed by a ternary digit;

FIG. 11 is a diagram illustrating an example of information encoded inan optical symbol;

FIG. 12 is a diagram illustrating an example of the optical symbol,where the number of colors that are assigned to cells of the opticalsymbol is 4;

FIG. 13 is a diagram illustrating an example of a process of creatingwork instructions with a color code;

FIG. 14 is a flowchart illustrating an example of a process of updatinga job status at a gate pass time point;

FIG. 15 is a flowchart illustrating an example of a process of updatingthe job status in a case of storing deliverables in an intermediatestorage;

FIG. 16 is a diagram illustrating an example of a UI screen displayed bythe work process management system;

FIG. 17 is a diagram illustrating an example in which seconddeliverables are obtained;

FIG. 18 is a diagram illustrating an example in which a second form iscreated;

FIG. 19 is a diagram illustrating an example of UI screens displayed bythe work process management system in a case where the seconddeliverables are obtained;

FIG. 20 is a diagram illustrating an example of a system according to athird embodiment;

FIG. 21 is a diagram illustrating an example of a hardware configurationof an information processing terminal;

FIG. 22 is a diagram illustrating an example of a functionalconfiguration of the system according to the third embodiment;

FIG. 23 is a diagram illustrating an example of a table in a storageunit that stores associated various pieces of information;

FIG. 24 is an example of a screen displayed by a display device;

FIG. 25 is a diagram illustrating a first example of a displayedmessage;

FIG. 26 is a diagram illustrating a second example of a displayedmessage; and

FIG. 27 is a diagram illustrating a third example of a displayedmessage.

DETAILED DESCRIPTION OF THE EMBODIMENTS

The present disclosure provides an information processing system wherebyit is possible to easily manage deliverables even when a plurality ofdeliverables are obtained from a deliverable (e.g., bulk of printmaterial, or the like) for a job (which is a unit of a job to beexecuted by a computer).

One or more embodiments will be hereinafter described with reference tothe drawings. Note that one or more embodiments will be described usingan example of a job management system whereby work processes for jobs ina printing plant are managed using work instructions (form).

First Embodiment

<System Configuration>

FIG. 1 is a diagram illustrating an example of a configuration of thejob management system according to the present embodiment.

FIG. 2 is a diagram illustrating an example of work instructions used inthe job management system according to the present embodiment.

In the job management system 1 illustrated in FIG. 1, a customer system10, a work process management system 14, a printer 16, and one or morecameras 18 are communicably connected to each other via a network 20such as the Internet or a LAN.

The customer system 10 is an example of an existing system used by acustomer and creates work instructions 800 used in the customer system10, as illustrated in FIG. 2 (A), where one or more barcodes arepresented on the work instructions 800.

A Job ID is an example of identification information for indicating ajob. At least one barcode image 801 used in the customer system 10 ispresented on the work instructions 800 for the customer system 10.

Note that, for the work instructions 800, the job ID may be presentedwith the barcode image 801, or be presented in text. The customer system10 provides a user with existing functions implemented by the workinstructions 800 for the customer system 10.

The work process management system 14, the printer 16, and the one ormore cameras 18 serve as an information processing system 12 that adds anew function to the work instructions 800. The work process managementsystem 14 uses work instructions 810 for the information processingsystem 12, to which a color code image 811 in FIG. 2 (B) is added, tomanage the progress of jobs associated with a plurality of workprocesses. The manner of management will be described in detail below.Note that the information processing system 12 can specify the job IDfrom the color code image 811, as described below.

The printer 16 prints the work instructions 810 for the informationprocessing system 12. Each camera 18 is installed to monitor an areawhere a given work process for the job is performed in the printingplant. Note that the area where the given work process for the job isperformed covers a pass point of a print material carried betweenprocess areas; a location of an intermediate storage where the printmaterial is temporarily stored; and the like.

Each camera 18 can include a PTZ (Pan Tilt Zoom) camera or an IP(Internet protocol) camera. The PTZ camera has a PTZ (Pan Tilt Zoom)function in which a field of view can be controlled via the network 20,and can transmit an image or a movie via the network 20. The IP camerais operable via the network 20, and can transmit an image or a movie viathe network 20. The image or movie captured by the camera 18 istransmitted to the work process management system 14 via the network 20.

For the information processing system 12 that adds a new function to thework instructions 800, the work instructions 810 for the informationprocessing system 12 are affixed to a print material that is an exampleof an intermediate product or material about a given job presented inthe work instructions 810. The work instructions 810 are affixed to theprint material that one or more cameras 18 easily photograph, forexample.

The work process management system 14 manages the progress (job status)of the work processes for jobs, based on the work process of the jobmonitored by a given camera 18 that photographs the work instructions810; and the job ID identified from the color code image 811 on the workinstructions 810. The work process management system 14 also photographsa work process history of jobs, as well as the work instructions 810, tomanage an image or a movie, the image or the movie representing asituation.

Note that the configuration of the job management system 1 isillustrated in FIG. 1, as an example. For example, the job managementsystem 1 may include other systems. The work process management system14 may be referred to by other names. The work process management system14 may be implemented by a single server, or be implemented by multipleservers.

<Hardware Configuration>

Each of the customer system 10 and the work process management system 14is implemented by a computer 500 that has a hardware configurationillustrated in FIG. 3, for example. Where, the computer 500 is anexample of an information processing device.

FIG. 3 is a diagram illustrating an example of the hardwareconfiguration of the computer. The computer 500 includes an input device501; a display device 502; an external I/F (Interface) 503; a RAM(Random access memory) 504; a ROM (Read-on memory) 505; a CPU (Centralprocessing unit) 506; a communication I/F (Interface) 507; an HDD (Harddisk drive) 508; and the like. These components are mutually connectedvia a bus B. Note that each of the input device 501 and the displaydevice 502 is separated from a main unit of the computer 500 and may beconnected to the main unit.

The input device 501 includes a keyboard, a mouse, a touch panel, andthe like. The input device 501 is used by a user to input operationsignals.

The display device 502 includes a display or the like. The displaydevice 502 displays a processed result by the computer 500.

The communication I/F 507 is an interface for connecting the computer500 to various networks. Thereby, the computer 500 can perform datacommunication via the communication I/F 507.

The HDD 508 is an example of a non-volatile storage device that storesone or more programs and data. The stored programs and data include anOS (Operation system), which is basic software for controlling theentire computer 500; application software (hereinafter simply referredto as an application) that provides various functions on the OS; and thelike. Note that the computer 500 may utilize a drive device (e.g., solidstate drive (SSD)) in which a flash memory is used as a storage medium.

The external I/F 503 is an interface with an external device. Forexample, the external device includes a recording medium 503 a or thelike. Thereby, the computer 500 can perform at least one from amongreading of the recording medium 503 a and writing of the recordingmedium 503 a, via the external I/F 503.

The recording medium 503 a includes a flexible disk, a CD, a DVD, an SDmemory card, a USB memory, or the like.

The ROM 505 is an example of a non-volatile semiconductor memory(storage device). The non-volatile semiconductor memory can store one ormore programs or data even when power is turned off. The ROM 505 storesat least one from among a BIOS executed when the computer 500 boots; OSsetting; one or more programs including a program for a networkconfiguration; and data.

The RAM 504 is an example of a volatile semiconductor memory (storagedevice) that temporarily stores one or more programs or data.

The CPU 506 is an arithmetic device that allows for the control andfunctions of the entire computer 500. In this case, the CPU 506retrieves one or more programs or data, from storage devices such as theROM 505 and the HDD 508, to perform processing.

Each of the customer system 10 and the work process management system 14can implement various processes described below, through the hardwareconfiguration of the computer 500 as illustrated in FIG. 3, for example.Note that explanation for the hardware configuration of each of theprinter 16 and the camera 18 will not be omitted.

<Software Configuration>

FIG. 4 is a diagram illustrating an example of a functionalconfiguration of the work process management system. Note that, in FIG.4, for illustrative purposes, the functional configuration isillustrated with partial omissions as appropriate. For example, the workprocess management system 14 includes a first receiving unit 401; ajob-ID identifying unit 402; a color code-image generating unit 403; anda storage unit 404. The work process management system 14 also includesan image-data generating unit 405; an image obtaining unit 406; acolor-code extracting unit 407; and a specifying unit 408.

The first receiving unit 401 receives work process data indicatingmultiple work process items; and image data (which is an example offirst image data) of the work instructions 800 (which is an example of afirst form) including information of a job ID.

Based on a user instruction, the first receiving unit 401 receives thenumber of second deliverables; and information indicating that workinstructions (second form) are created for each second deliverable, whenmultiple deliverables (second deliverables) are obtained from a givendeliverable (first deliverable) in a certain work process (which is anexample of a first work process).

Further, when multiple deliverables obtained from a given deliverableare second deliverables, the first receiving unit 401 receives secondjob IDs described below corresponding to the respective seconddeliverables.

The first receiving unit 401 may control a display of various screenssuch as a screen for receiving various settings from the user; a jobstatus list screen described below; and a job history detailed screen,to receive input from the user. Alternately, the first receiving unit401 may receive information output from an information processingterminal that can communicate with the computer 500.

For example, the job-ID identifying unit 402 identifies a job IDpresented on the barcode image 801 or presented in text, from the firstimage data of the work instructions 800 for the customer system 10 inFIG. 2(A).

The job-ID identifying unit 402 is an example of a job-ID generatingunit. When the first receiving unit 401 receives the number of seconddeliverables; and information indicating that a second form of eachsecond deliverable is created, the job-ID identifying unit 402 generatesjob IDs (second job IDs) in each of which a suffix number is added to anidentified job ID.

In a work process, when multiple deliverables obtained from a givendeliverable are second deliverables, the job-ID identifying unit 402retrieves a first job ID corresponding to the second deliverables, fromthe storage unit 404 described below, and adds one or more unused suffixnumbers to the first job ID to generate respective new second job IDs.

The color-code image generating unit 403 generates color code data(which is an example of first color code data, e.g., “A-00”) of a colorcode indicating a color code ID corresponding to the first job ID, basedon the first job ID identified by the job-ID identifying unit 402, wherethe color code ID is set by a plurality of colors.

The color-code image generating unit 403 generates color code data(which is an example of second color code data, e.g., “A-01” or “A-02”)of a color code indicating a color code ID corresponding to a givensecond job ID, based on the job ID (second job ID) generated by thejob-ID identifying unit 402, where the color code ID is set by aplurality of colors.

The storage unit 404 stores work process data received by the firstreceiving unit 401; one or more job IDs identified by the job-IDidentifying unit 402; one or more second job IDs generated by the job-IDidentifying unit 402; first color code data; and second color code data,to be associated with each other.

FIG. 5 is a diagram illustrating an example of a table in the storageunit, the table storing associated various pieces of information. In thetable T1, five processes including “printing,” “cutting,” “folding,”“bookbinding,” and “inspecting”; statuses of processes; and variouspieces of information are associated to be stored, where the processesare indicated by the work process data received by the first receivingunit 401.

The image-data generating unit 405 generates image data (which is anexample of second image data) of a second form in which a color codecorresponding to a first color code is added to a given first form,based on the first image data and the first color code data.

FIG. 6 is a diagram illustrating an example of a table in the storageunit, the table storing pieces of identification information of cameras;and work process statuses to be associated with each other, where eachcamera is an example of an imaging device. For example, the table T2stores pieces of identification information of cameras; and work processstatuses to be associated with each other, as illustrated in FIG. 6. Theimage-data generating unit 405 also generates image data (which is anexample of third image data) of a third form in which a color codecorresponding to a given second color code is added to a given firstform, based on the first image data and the second color code data.

FIG. 2(A) is an example of the first form. FIG. 2(B) is an example ofthe second form.

The image obtaining unit 406 obtains an image or a movie from a givencamera 18.

The color-code extracting unit 407 extracts a color code ID from thecolor code image 811 of a given second form that is included in theimage or the movie.

The color-code extracting unit 407 extracts first color code data fromthe color code image 811 of a given third form that is included in theimage or the movie. Alternatively, the color-code extracting unit 407extracts second color code data from the color code image 811 of a giventhird form that is included in the image or the movie.

For example, the color-code extracting unit 407 outputs, to thespecifying unit 408, identification information for indicating either ofa given camera 18 that photographs the color code image 811 or acorresponding work process for the job; and either of extracted firstcolor code data or second color code data.

The specifying unit 408 specifies the first job ID with reference to thestorage unit 404, based on the first color code data extracted by thecolor-code extracting unit 407. The specifying unit 408 also specifiesthe status of the work process associated with the first job ID, basedon the status of the work process associated with a given camera 18 thatphotographs the color code image 811.

Alternatively, the specifying unit 408 specifies the second job ID withreference to the storage unit 404, based on the second color code dataextracted by the color-code extracting unit 407. The specifying unit 408also specifies the status of the work process associated with the secondjob ID, based on the status of the work process associated with a givencamera 18 that photographs the color code image 811.

Thereby, the specifying unit 408 can specify progress information (jobstatus indicating a status of the work process) for the work process ofthe job, based on the status of the work process associated with a givencamera 18 that photographs the color code image 811, and, one from amongthe first color data extracted by the color-code extracting unit 407; agiven first job ID; and a given second job ID.

<Process>

FIG. 7 is a diagram illustrating an example of the work processes in theprinting plant. In the example in FIG. 7, the processes include“printing”, “cutting”, “folding”, “bookbinding”, “inspecting”,“intermediate storage 1”, and “intermediate storage 2”. In this example,cameras 18 a 1, 18 a 2, 18 a 3, 18 a 3, 18 a 4, and 18 a 5 are installedon respective gates in front of locations where the work processes of“printing,” “cutting,” “folding,” “bookbinding,” and “inspecting” areperformed. Further, cameras 18 b 1 and 18 b 2 are installed inrespective locations where work processes of “intermediate storage 1”and “intermediate storage 2” are set. In the following, the cameras 18 a1 through 18 a 5 and the cameras 18 b 1 and 18 b 2 are collectivelyreferred to as “cameras 18”. The cameras 18 a 1 through 18 a 5 are alsocollectively referred to as “cameras 18 a”. Additionally, the cameras 18b 1 and 18 b 2 are collectively referred to as “cameras 18 b”.

When the work instructions 810 for the information processing system 12are being carried from one work process area to another work processarea, or are temporarily stored in a given intermediate storage, etc.,the work instructions 810 are photographed by the camera 18 a or thecamera 18 b. In FIG. 7, arrows expressing job flows of the whole workprocesses are illustrated as well as arrows each expressing a job flowin which the work processes are partially skipped.

In the example in FIG. 7, a print material is output in the work process“printing” and then the work instructions 810 are affixed to the printmaterial. In such a manner, the work instructions 810 affixed to theprint material are photographed by the camera 18 a or the camera 18 b,when the print material passes a given gate or is stored in a givenintermediate storage.

In the example of FIG. 7, the camera 18 a 1 is used in the work processof “printing”, the camera 18 a 2 is used in the work process of“cutting”, and the camera 18 a 3 is used in the work process of“folding”. The camera 18 a 4 is used in the work process of“bookbinding”, and the camera 18 a 5 is used in the work process of“inspecting”.

In the example in FIG. 7, the camera 18 b 1 is used in the process of“printing process completed”, and the camera 18 b 2 is used in theprocess of “folding process completed”.

<Creation of Work Instructions with Color Code>

FIG. 8 is a flowchart illustrating an example of a process of creating asecond form based on a first job ID.

In step S11, the job-ID identifying unit 402 identifies a first job IDthat is presented with the barcode image 801 on the work instructions800 for the customer system 10, or that is presented in text on the workinstructions 800 for the customer system 10. Note that a scan frame foridentifying the first job ID may be preset by an operator, or isautomatically set using a OCR (Optical character recognition) or thelike.

In step S12, the color-code image generating unit 403 generates thefirst color code data of a color code, based on the first job IDidentified by the job-ID identifying unit 402 in step S11, where thecolor code is expressed using multiple colors and expresses informationindicating the first job ID.

In step S13, in accordance with the process in FIG. 9, the color-codeimage generating unit 404 generates the color code image 811 based on acolor code ID corresponding to the first job ID. Note that the processin FIG. 9 is described in Japanese Unexamined Patent ApplicationPublication No. 2017-199306.

FIG. 9 is a flowchart illustrating an example of the process ofgenerating the color code image.

In step S21, the color-code image generating unit 403 receives a colorcode ID of a target color code.

In step S22, the color-code image generating unit 404 identifies a valueof each digit, from a character string of the color code ID.

In step S23, the color-code image generating unit 404 uses theidentified value of each digit to obtain a value set based on the numberof colors that are assigned to respective cells of an optical symbolthat is described in Japanese Unexamined Patent Application PublicationNo. 2017-199306. For example, when the number of colors that areassigned to cells is 4, the color-code image generating unit 403 usesthe value of each digit to obtain a value of a ternary number, accordingto an encoding rule illustrated in FIG. 10, for example.

FIG. 10 is a diagram illustrating an example of the encoding rule for anumber expressed by a ternary digit. In the example in FIG. 10, theencoding rule in which four colors of R (red), G (green), B (blue), andK (black) are used is described as an example. In the case of the fourcolors, a ternary digit, i.e., a value of a ternary number can berepresented.

For example, when viewed from a clockwise direction illustrated in FIG.10(a), transitions from the R color into the K color; from the K colorinto the B color; from the B color into the G color; and the G color tothe R color are each expressed by the value “0”. Also, when viewed froma counterclockwise direction illustrated in FIG. 10(a), transitions fromthe R color into the G color; from the G color into the B color; fromthe B color into the K color; and the K color to the R color are eachexpressed by the value “1”. Further, transition between the R color andthe B color that are diagonally positioned, as well as transitionbetween the K color and the G color that are diagonally positioned, areeach expressed by the value “2”.

For example, as illustrated in FIG. 10(b), for cell columns in whichcells for the G color, the R color, the B color, the K color, and the Gcolor are sequentially aligned, when viewed from the left to the rightin this figure, the transition from the G color to the R color isexpressed by the value “0”. The transition from the R color to the Bcolor is expressed by the value “2”, the transition from the B color tothe K color is expressed by the value “1”, and the transition from the Kcolor to the G color is expressed by the value “2”. As a result, thearray in FIG. 10(b) is represented by the value “3d2120”, i.e., thedecimal value “69”. Note that the value notation of “3d” at thebeginning indicates that the following number is a value in a ternarynumber.

The encoding rule based on transition of four colors is not limited tothe example illustrated in FIG. 10(a). For example, the encoding rulemay be taken as illustrated in an example in FIG. 10(d). FIG. 10(e)illustrates an example of a conversion table in which color transitionis expressed by a given value according to the encoding rule illustratedin FIG. 10(d). In FIG. 10(e), for example, when a source cell for the Rcolor is expressed by the value “2”, a destination cell adjacent to thesource cell is expressed by the B color. Similarly, when a source cellfor the K color is expressed by the value “1”, a destination celladjacent to the source cell is expressed by the G color.

In FIG. 9, after step S23, the process proceeds to step S24. In stepS24, with reference to the conversion table based on the encoding ruleas illustrated in FIG. 10(a), the color-code image generating unit 403assigns colors to respective cells of the optical symbol, based oncolors of given source cells; and the values of the ternary numberobtained in step S23. Note that the color-code image generating unit 36preliminarily stores a color pattern for cell columns of a main code ofthe optical symbol.

With reference to FIGS. 11 and 12, a more specific example in which thenumber of colors that are assigned to cells of the optical symbol is 4will be described.

FIG. 11 is a diagram illustrating an example of information that isencoded in the optical symbol.

FIG. 12 is a diagram illustrating an example of the optical symbol,where the number of colors that are assigned to cells of the opticalsymbol is 4.

In the example in FIG. 11, for cell columns of a sub-code section 301,values of “3d1,” “3d1,” “3d0,” and “3d1” correspond to respective cellsof “d1,” “d2,” “d3,” and “d4” of a main code section 300.

In the example in FIG. 12, the information illustrated in FIG. 11 isencoded according to the encoding rule described in FIG. 10 to obtainthe coded optical symbol. In this example, the main code section 300includes an even number of cells in a column of cells, where the K coloris assigned to a start cell, and the K color and the R color arealternatively positioned.

For a left end cell of the sub-code section 301, for example, a color isassigned, where a first source color is the K color for a cell of themain code section 300 corresponding to the left end cell. In the examplein FIG. 12, with reference to the conversion table based on the encodingrule in FIG. 10(a), the R color is assigned to the left end cell of thesub-code section 301 of the optical symbol, based on the K color for thesource cell of the main code section 300; and the value “3d1” for thecell of the sub-code section 301.

After step S13 in FIG. 8, the process proceeds to step S14. In step S14,a color-code work instructions creating unit uses the color code image811 generated in step S13 to create the work instructions 810 for theinformation processing system 12.

FIG. 13 is a diagram illustrating an example of a process of creatingwork instructions with a color code. Note that a paper size, a layoutframe, or the like may be set in advance by the operator. The workinstructions 800 for the customer system 10 in FIG. 2(A) are scaled downto include an empty space. The work instructions 810 for the informationprocessing system 12 in FIG. 2(B) include the color code image 811 in anempty space caused by scaling down the work instructions 800 for thecustomer system 10.

Note that at least one barcode image 801 used in the customer system 10is presented on the work instructions 800 for the customer system 10, asillustrated in FIG. 2(A). If the work instructions 800 for the customersystem 10 are merely scaled down, the barcode image 801 may be unable tobe available (unrecognized).

In light of the point described above, in order to provide the emptyspace without impairing the barcode image 801, the color-code workinstructions creating unit checks a direction in which the barcode image801 is scanned, and may scale down the work instructions in a directionof the barcode image 801 not being impaired, etc.

As described above, the work process management system 14 according tothe present embodiment scales down the work instructions in thedirection of the barcode image 801 not being impaired, to provide theempty space. Further, the work process management system 14 can add thecolor code image 811 in the empty space, the color code image 811 beingremotely readable. In such a manner, even when the work instructions 800for the customer system 10 are scaled down, the barcode image 801 is notimpaired. In other words, the work instructions 800 for the customersystem 10 are successfully available and the code image 811 can besuccessfully added to the work instructions 810 for the informationprocessing system 12.

In FIG. 8, in step S15, the image data generating unit 405 instructs theprinter 16 to print the work instructions 810 (work instructions with acolor code) for the information processing system 12, the workinstructions 810 including the color code image 811 generated in stepS14. In response to receiving an instruction from a print instructingunit, the printer 16 prints the work instructions 810 for theinformation processing system 12, the work instructions 810 includingthe color code image 811 as illustrated in FIG. 2(B).

<Update Job Status at Gate Pass Time Point>

In the job management system 1 according to the present embodiment, whenthe cameras 18 a 1 through 18 a 5, and the cameras b1 and b2 eachphotograph the work instructions 810 for the information processingsystem 12, the job statuses in the storage unit 404 are updated asfollows. Where, the work instructions 810 include the color code image811.

FIG. 14 is a flowchart illustrating an example of a process of updatingthe job status at a gate pass time point.

In step S51, when the image obtaining unit 406 of the work processmanagement system 14 obtains an image or a movie from a given camerafrom among the cameras 18 a 1 through 18 a 5 and the cameras 18 b 1 and18 b 2, the process proceeds to step S52.

In step S52, the color-code extracting unit 407 extracts the color codeimage 811 from the image or the movie being obtained by the imageobtaining unit 406.

In step S53, the color-code extracting unit 407 performs recognitionprocessing of the color code image 811 according to the processdescribed in Japanese Unexamined Patent Application Publication No.2017-199306, for example.

When the color code image 811 is recognized, the color-code extractingunit 407 extracts an image for each cell, from the color code image 811.

In step S54, the color-code extracting unit 407 recognizes, as symbolinformation, color information for each cell; and link information foreach cell, as recognized in step S53. A color-code recognizing unitdecodes the symbol information according to the encoding ruleillustrated in FIG. 10(A), to restore an original color code ID that isencoded in the color code image 811.

In step S55, the color-code extracting unit 407 transmits, to thespecifying unit 408, e.g., identification information of the givenimaging camera that photographs the color code image 811, from among thecameras 18 a 1 through 18 a 5 and the cameras 18 b 1 and the cameras 18b 2, as well as the color code ID restored by decoding. Then, thespecifying unit 408 specifies the job ID corresponding to the color codeID, with reference to the storage unit 404.

For example, based on the identification information of the camera 18 athat photographs the color code image 811; and the job ID correspondingto the color code ID that is restored from the color code image 811, thespecifying unit 408 can change the job status stored in the storage unit404, from “unidentified” to a given status such as “passed” or “processcompleted”.

<Update of Job Status when Deliverables are Stored in IntermediateStorage>

In the job management system 1 according to the present embodiment, whenthe work instructions 810 for the information processing system 12,which include the color code image 811, are photographed by the camera18 b 1 or the camera 18 b 2, the job status stored in the storage unit404 is updated as follows.

FIG. 15 is a flowchart illustrating an example of a process of updatingthe job status when deliverables are stored in the intermediate storage.

In step S61, the image obtaining unit 406 of the work process managementsystem 14 obtains the image from the camera 18 b 1 or the camera 18 b 2,and then the process proceeds to step S62.

In step S62, the color-code extracting unit 407 extracts the color codeimage 811, from the image or the movie captured by the image obtainingunit 407.

In step S63, the color-code extracting unit 407 performs recognitionprocessing of the color code image 811 according to the processdescribed in Japanese Unexamined Patent Application Publication No.2017-199306, for example.

In step S64, when the color-code extracting unit 407 recognizes thecolor code image 811, the process proceeds to step S65.

In step S65, the color-code extracting unit 407 decodes symbolinformation recognized based on the color code image 811 to restore anoriginal color code ID that is encoded in the color code image 811.

In step S66, the color-code extracting unit 407 transmits, to thespecifying unit 408, e.g., identification information of the camera 18 b1 or the camera 18 b 2 that photographs the color code image 811; andthe color code ID that is recovered by decoding. Then, the specifyingunit 408 specifies the job ID corresponding to the color code ID, withreference to the storage unit 404.

The specifying unit 408 determines whether a predetermined time haselapsed without a change in the job status for the job ID, based on,e.g., the identification information of the camera 18 b 1 or the camera18 b 2 that photographs the color code image 811; and the job IDcorresponding to the color code ID that is restored from the color codeimage 811.

When a predetermined time has elapsed without a change in the jobstatus, the specifying unit 408 proceeds to step S67.

In step S67, the specifying unit 408 indicates an alert for a retaineddeliverable, on the job history detailed screen described below, andthen proceeds to step S70. In contrast, when a predetermined time hasnot elapsed without a change in the job status, the job management unit408 proceeds to step S70.

In step S70, the specifying unit 408 can change the job status stored inthe storage unit 404, from “unidentified” to a given status such as“during work process” or “work process completed.”

In step S64, when the color code image 811 is not recognized by thecolor-code extracting unit 407, the color-code extracting unit 407proceeds from step S64 to step S68. In this case, when the color codeimage 811 is not recognized from the image that is captured by thecamera 18 b 1 or the camera 18 b 2 installed in the intermediatestorage, the job status is updated for the job ID about the deliverablestored in the intermediate storage.

For example, the color-code extracting unit 407 transmits, to thespecifying unit 408, the identification information of the camera 18 b 1or the camera 18 b 2. Then, the specifying unit 408 determines whetherthere is a job ID corresponding to the color code image 811 that is notrecognized a predetermined number of times in a row from the images,from among one or more job IDs each of which relates to the job statusof “work process completed”, the job status being about the storageassociated with the identification information of the camera 18 b 1 orthe camera 18 b 2.

In step S68, the specifying unit 408 determines whether there is nocolor code a predetermined number of times in a row. When there is a jobID corresponding to the color code image 811 that is not recognized apredetermined number of times in a row from the images, from among oneor more job IDs each of which relates to the job status of “work processcompleted” being about the storage, the specifying unit 408 proceeds tostep S69.

In step S69, the specifying unit 408 sets the color code ID associatedwith the job ID, to be null, and then proceeds to step S70.

In a case of print materials being stacked, etc., the work instructions810 for the information processing system 12 may be stored not to bephotographed by the camera 18 b. In light of the situation, thespecifying unit 408 skips step S69 to proceed from step 68 to step 70,when there is no job ID corresponding to the color code image 811 thatis not recognized a predetermined number of times in a row from theobtained image.

According to the flowcharts of FIGS. 14 and 15, the job status for theprint material to which the work instructions 810 for the informationprocessing system 12 are affixed is automatically updated. Thereby, theprint material to which the work instructions 810 for the informationprocessing system 12 are affixed can be tracked.

<Job Query>

An operator of the job management system 1 can use various UI (Userinterface) screens provided by the work process management system 14, toquery at least one from among progress information of the work processesfor jobs in the printing plant; history information; an image file; amovie file; and the like. Where, each of the image file and the moviefile represents a situation when the work instructions 810 arephotographed. Note that each UI screen is a screen displayed by thedisplay device 502.

FIG. 16 is a diagram illustrating an example of the UI screen in thework process management system. In the work process management system14, for example, the job status list screen 1000 is displayed by thedisplay device 502. The job status list screen 1000 includes a list ofjob information including job IDs; color code IDs, job names; latestupdate data; and progress information of one or more work processes.

The progress information indicates the progress selected from among“unidentified,” “during work process,” “work process completed,” and“alert”.

The work process progress “unidentified” indicates that the workinstructions 810 for the information processing system 12 are notphotographed by the camera 18 for a target work process.

The work process progress “during work process” indicates that the workinstructions 810 for the information processing system 12 arephotographed by a given camera for a target work process, from among thecameras 18 a 1 through 18 a 5.

The work process progress “work process completed” indicates that thelatest updated work instructions 810 for the information processingsystem 12 are photographed by a given camera for a target work process,from among the camera 18 b 1 and the camera 18 b 2. The work processprogress “alert” indicates that an alert such as an alert for a retaineddeliverable is transmitted.

The operator can select one job from the job status list screen 1000 tocause the job history detailed screen 1010 to be displayed. The jobhistory detailed screen 1010 includes each button for switching thescreen 1010 to a screen that includes, for each work process, a startdate and time; completion date and time; a captured image; and acaptured movie. Note that in a case of the work process of “intermediatestorage 1” or “intermediate storage 2,” the job history detailed screen1010 also includes a location of a storage area being a storage place.

A given button in the job history detailed screen 1010 is operated toswitch the screen 1010 to a screen 1020 for displaying an image or amovie; or a screen 1030 for expressing a storage. When the button ispressed, the first receiving unit 401 switches the job history detailedscreen 1010 to the screen 1020 or the screen 1030. When a play button ispressed through the screen 1020 for displaying an image or a movie, animage file or a movie file is selected and a situation when the workprocess instructions 810 are captured is provided.

<Example of Second Deliverable>

FIG. 17 is a diagram illustrated an example in which second deliverablesare obtained.

FIG. 18 is a diagram illustrated an example in which a second form iscreated.

For example, as illustrated in FIG. 17, a case where work processes ofmaking a product such as a print material includes five work processesof a submitting process; a printing process; a cutting process; afolding process; and a bookbinding process will be described as anexample. Note that the number of work processes; a type of workprocesses; an order of work processes; a type of products; and the likemay be taken as the case that differs from the case illustrated in FIG.17.

First, in this example, for each printing job, the submitting process,the printing process, the cutting process, the folding process, and thebookbinding process are set. Job IDs are assigned in a planning phase ororder entry phase, etc. before the processes are performed. In thisexample, each first job ID is assigned into a first deliverable, whichis a deliverable from which second deliverables are then obtained.

Hereafter, a case where the second deliverables are derived from thefirst deliverable will be described. Note that each of the firstdeliverable and the second deliverables may be managed using a numberother than the suffix number. For example, the second deliverables maybe managed to be associated with respective control numbers or the like.

For example, the control number of each second deliverable may be takenas information (which is an example of distinguishing information) fordistinguishing between the first deliverable and the second deliverable,the information including a combination, etc. of a character, except fora subscript or the job ID; and a letter.

Specific examples in which the second deliverables are obtained will bedescribed below.

A first case will be taken as an example in which a second form as a newform is created based on the first form.

A case where a plurality of devices are used in one work process will bedescribed. In the example in FIGS. 17 and 18, in the printing process, aplurality of printing machines (in the illustrated example, two printingmachines are used) are used.

In FIG. 17, a first job ID “A” is assigned to a print job for an objectsubmitted in the submitting process. Note that in this example, thesuffix number “-00” is added to the job ID “A” to thereby obtain thefirst job ID. However, the job ID is not limited to this example. In thepresent embodiment, the suffix-numbered job ID is expressed by “A-XX”.

Note that the case of obtaining the second deliverables is not limitedto the case where the plurality of devices are used. For example, oneprocess may be performed by multiple operators, or be performed inmultiple locations.

In the submitting process, as illustrated in FIG. 17, the job ID is oneID of “A-00” and one form is used.

In the printing process, a new form is created based on the first form.In this example, the first form that is managed using thesuffix-numbered job ID “A-00”, as well as the second form [A] that ismanaged using the suffix-numbered job ID “A-01”, are used.

The second form [A] is created based on the suffix-numbered job ID“A-01”. In this case, entries are recorded on the second form “A”, as inthe case with the first form.

Next, a color code (hereinafter referred to as a second color code “A”)corresponding to the suffix-numbered job ID “A-01” is assigned to thesecond form [A]. In this case, when the second color code “A” on thesecond form [A] is recognized in step S63 or the like, the status, etc.for the job ID such as the job ID “A”, which is managed using the secondform [A] corresponding to the suffix-numbered job ID “A-01”, can bemanaged.

Information such as a number (hereinafter referred to as a “secondcontrol number <A>”) indicating the suffix number “01” may be furtherrecorded on the second form [A].

Hereafter, a case where, before a certain work process, one deliverableis present and then multiple deliverables are obtained will bedescribed. For example, in the example illustrated in FIGS. 17 and 18,the cutting process is performed using one cutting machine. Note thatthe number of cutting machines is not limited to one, and may be plural.

For example, the print materials of a cover, a body, a back cover, orthe like are different deliverables, and are managed using the same jobID. However, when the above different deliverables are separatelymanaged, respective second forms may be newly created.

For example, for the suffix-numbered job ID “A-00”, deliverablesobtained in the cutting process are managed using the suffix-numberedjob ID “A-00” and the suffix-numbered job ID “A-02”. In this case, inthe work process after the cutting process, although the respectivedeliverables corresponding to the first form and the second form aremanaged using the same job ID “A”, the different suffix numbers are usedto manage the deliverables, where the first form corresponds to thesuffix-numbered job ID “A-00”, and the second form corresponds to thesuffix-numbered job ID “A-02”.

Before the cutting process in which the deliverable managed using thesecond form [B] is obtained, the “A-00” is assigned to one deliverableand is managed using the first form. Then, the second form [B] iscreated based on the first form. The second form includes entries, as isthe case with the first form.

The second form [B] includes a color code (hereinafter referred to as a“second color code B”) corresponding to the suffix-numbered job ID“A-02”. In this case, when the second color code “B” on the second form[B] is recognized in step S63 or the like, the status, etc. for the jobID “A”, which is managed using the second form [B] corresponding to thesuffix-numbered job ID “A-02”, can be managed.

The second form [B] may further include information such as a number(hereinafter referred to as a “second control number <B>”) indicatingthe suffix number “02”.

As illustrated in FIG. 18, for the deliverable that is managed using thefirst form corresponding to the suffix-numbered job ID “A-00”, in thecutting process, the status, etc. can be managed using the job ID “A”,which is managed using the first slit corresponding to thesuffix-numbered job ID “A-00”; and the second slit [B] corresponding tothe suffix-numbered job ID “A-02”.

A second case will be taken as an example in which a new form is furthercreated based on the second form. In the example of the cutting processillustrated in FIGS. 17 and 18, an example will be described using onecutting machine. Note that the number of cutting machines is not limitedto one, and may be plural.

In this case, for the suffix-numbered job ID “A-01”, respectivedeliverables made in the cutting process are managed using thesuffix-numbered job ID “A-01” and the suffix-numbered job ID “A-03”. Inother words, in the work processes after the cutting process, althoughthe deliverables corresponding to the second form [A] and the secondform [C] are managed using the same job ID “A”, different suffix numbersare used to manage the deliverables. Where, the second form [A]corresponds to the suffix-numbered job ID “A-01”, and the second form[C] corresponds to the suffix-numbered job ID “A-03”.

Before the cutting process, the deliverable corresponding to the secondform [C] is one deliverable, and is managed using the second form [A].The second form [C] is created based on the second form [A]. The secondform [C] includes entries, as is the case with the first form.

The second form [C] includes a color code (hereinafter referred to as a“second color code C”) corresponding to the suffix-numbered job ID“A-03”. In this case, when the second color code “C” on the second form[C] is recognized in step S63 or the like, the status, etc. for the jobID “A”, which is managed using the second form “C” corresponding to thesuffix-numbered job ID “A-02”, can be managed.

The second form [C] may further include information such as a number(hereinafter referred to as a “second control number <C>”) indicatingthe suffix number “02”.

As illustrated in FIG. 18, for the deliverable that is managed using thesecond form [A] corresponding to the suffix-numbered job ID “A-01”, inthe cutting process, the status, etc. can be managed using the job ID“A”, which is managed using the second slit [A] corresponding to thesuffix-numbered job ID “A-01”; and the second slit [C] corresponding tothe suffix-numbered job ID “A-03”.

As described above, the new color code is assigned to the newdeliverable derived from a given deliverable, and the barcode itemsincluded in printing instructions are maintained. Further, when the newjob ID is assigned to the second form, the suffix number is added to thejob ID for the first form. Thereby, the information system can use thesame job ID to manage the deliverables (which are each specified by thesame job ID) including the deliverable corresponding to the first slitand the deliverables corresponding to the second slits.

In such a manner, the second forms may be created for each work process;each deliverable obtained in the work process; each material; eachtransportation equipment; or each device that is used. Alternatively,the second form may be created for a combination of items selected fromamong the work process, the deliverable, material, transportationequipment, and a used device.

As described above, the suffix numbers or the like are used in themanagement, and the management can be thereby achieved finely.

Note that the second form may be created in a manner except for a casewhere the second form is created when the code of the job ID asillustrated in FIG. 18 is scanned. For example, the second form may becreated in a case such as a case of detecting that a button or the likeon a setting screen, etc. is pressed by the user.

The manner of creating the second form is not limited to the mannerdescribed with reference to the figures. For example, the second formmay include an additional item except for the entries that are copied.For example, the additional item includes a cause of the second formbeing created, etc.

The second control number <A>; the second control number <B>; the secondcontrol number <C>; a print position; a print size; a print range; andthe like may be set in advance.

Hereafter, UI screens displayed by the work process management system ina case where the second deliverables are obtained will be described.

FIG. 19 is a diagram illustrating an example of the UI screens displayedby the work process management system in a case where the seconddeliverables are obtained. For example, a job status list screen(hereinafter referred to as a “pre-transition screen PN1”) in the casewhere the second forms are created, as illustrated in FIG. 19, isgenerated to be displayed in the same manner as the job status listscreen illustrated in FIG. 16 or the like.

The pre-transition screen PN1 differs from the job status list screen1000 illustrated in FIG. 16, in that suffix-numbered job IDscorresponding to the second forms are grouped to be displayed. In thisexample, when a button IFA on the GUI (Graphical user interface) ispressed, a post-transition screen PN2 or the like is displayed, as anexample.

As illustrated in FIG. 19, the post-transition screen PN2 includes thesuffix-numbered job IDs corresponding to the second forms. In otherwords, the post-transition screen PN2 includes a list of the statuses ofjobs that are managed using the suffix numbers; or the like.

In such a manner, the button IFA is used to receive an instruction todisplay or hide a screen relating to one or more suffix-numbered job IDseach of which is managed to be associated with a given job ID. When thebutton IFA included in the post-transition screen PN2 is displayed, inthe case of the button IFA being pressed, the post-transition screen PN2is hidden and the pre-transition screen PN1 is again displayed.

In the example in FIG. 19, the post-transition screen PN2 includes“latest update” and a “location”. Where, the “latest update” indicatesthe date and time of updating the status for one or more givendeliverables corresponding to the second forms, and the “location”indicates a place, etc. where each deliverable corresponding to thesecond form is located.

As described above, the suffix-numbered job IDs corresponding to thesecond forms can be also managed through the job status list screen orthe like. Thereby, the work process or the like can be more easilymanaged.

Further, in such a manner, the statuses for the deliverablescorresponding to the second forms can be managed together, based on thejob IDs. In such management, jobs derived from one job ID can be easilymanaged. Further, the second forms can be easily created in a case ofjobs being newly given, or the like.

The second forms, as well as the deliverables corresponding to therespective second forms, can be easily managed to thereby easily manageactual deliverables, the progress, and capacity, in the work processesor the like.

Third Embodiment

In the first embodiment and the second embodiment, the suffix-numberedjob IDs are generated, and the second forms are created accordingly. Insuch a manner, each of the deliverables can be managed, even when thedeliverables are obtained from a given deliverable before and after agiven work process.

In the third embodiment, the worker in a work process (second workprocess) can check if a first work process before the second workprocess is completed, or if deliverables are all obtained in the firstwork process.

For example, in the bookbinding process in FIG. 17, the worker cannotperform the bookbinding process unless all deliverables are obtained.Specifically, the worker cannot perform the bookbinding process unlessthe deliverable represented by the first form corresponding to thesuffix-numbered job ID “A-00”; the deliverable corresponding to thesuffix-numbered job ID “A-01”; the deliverable corresponding to thesuffix-numbered job ID “A-02”; the deliverable corresponding to thesuffix-numbered job ID “A-03”; the deliverable corresponding to thesuffix-numbered job ID “A-04”; the deliverable corresponding to thesuffix-numbered job ID “A-05”; the deliverable corresponding to thesuffix-numbered job ID “A-06”; and the deliverable corresponding to thesuffix-numbered job ID “A-07” are not all obtained.

In light of the point described above, the third embodiment will bedescribed using a system in which a notification is indicated to theworker in the second work process following the first work process, whenall deliverables are obtained in the first work process, where thesystem manages the number of deliverables that are obtained, in thefirst work process, from a given deliverable present before the firstwork process.

FIG. 20 is a diagram illustrating an example of the system according tothe third embodiment. In FIG. 20, the customer system 10; the workprocess management system 14, the printer 16; and each camera 18 arecomponents that are the same as the components described in the firstembodiment and the second embodiment; accordingly, the explanation forthose components will be omitted.

An information processing terminal 22 is a terminal carried by a worker,and includes a tablet, a smartphone, or the like.

FIG. 21 is a diagram illustrating an example of a hardware configurationof the information processing terminal. For example, the informationprocessing terminal 22 has the same hardware configuration as thecomputer 500 illustrated in FIG. 3.

The information processing terminal 22 includes an input device 1901; adisplay device 1902; an external I/F (Interface) 1903; a RAM (Randomaccess memory) 1904; a ROM (Read-on memory) 1905; a CPU (Centralprocessing unit) 1906; a communication I/F (Interface) 1907; an HDD(Hard disk drive) 1908; and the like. These components are mutuallyconnected via a bus B. Note that each of the input device 1901 and thedisplay device 1902 is separated from the information processingterminal 22 and may be connected to the information processing terminal22.

The input device 1901 includes a keyboard, a mouse, a touch panel, andthe like. The input device 1901 is used by a user to input operationsignals.

The display device 1902 includes a display or the like. The displaydevice 1902 displays a processed result by the information processingterminal 22.

The communication I/F 1907 is an interface for connecting theinformation processing terminal 22 to various networks. Thereby, theinformation processing terminal 22 can perform data communication viathe communication I/F 1907.

The HDD 1908 is an example of a non-volatile storage device that storesone or more programs and data. The stored programs and data include anOS (Operation system), which is basic software for controlling theentire information processing terminal 22; application software thatprovides various functions on the OS; and the like. Note that theinformation processing terminal 22 may utilize a drive device (e.g.,solid state drive (SSD)) in which a flash memory is used as a storagemedium.

The external I/F 1903 is an interface with an external device. Forexample, the external device includes a recording medium 1903 a or thelike. Thereby, the information processing terminal 22 can perform atleast one from among reading of the recording medium 1903 a and writingof the recording medium 1903 a, via the external I/F 1903.

The recording medium 1903 a includes a flexible disk, a CD, a DVD, an SDmemory card, a USB memory, or the like.

The ROM 1905 is an example of a non-volatile semiconductor memory(storage device). The non-volatile semiconductor memory can store one ormore programs or data even when power is turned off. The ROM 1905 storesat least one from among a BIOS executed when the information processingterminal 22 boots; OS setting; one or more programs including a programfor a network configuration; and data.

The RAM 1904 is an example of a volatile semiconductor memory (storagedevice) that temporarily stores one or more programs or data.

The CPU 1906 is an arithmetic device that allows for the control andfunctions of the entire information processing terminal 22. In thiscase, the CPU 1906 retrieves one or more programs or data, from storagedevices such as the ROM 1905 and the HDD 1908, to perform processing.Note that the information processing terminal 22 may include a differenthardware configuration from the computer 500.

FIG. 22 is a diagram illustrating an example of a functionalconfiguration of the system according to the third embodiment. Thesystem according to the third embodiment includes a first receiving unit401; a job-ID identifying unit 402; a color-code image generating unit403; a storage unit 404; an image-data generating unit 405; and an imageobtaining unit 406. Further, the system includes a color-code extractingunit 407; a specifying unit 408; a second receiving unit 2001; an outputunit 2002; a display controller 2003; and a display controller 2004. Inthe following description, the explanation for the configurations thatare the same as the configurations described in the first embodiment andthe second embodiment will be omitted as appropriate.

The first receiving unit 401 receives, from the output unit 2002described below, the number of deliverables that are obtained, in thefirst work process, from a given deliverable corresponding to a firstform.

When the job-ID identifying unit 402 receives the number of deliverablesthat are obtained from the given deliverable corresponding to the firstform, the job-ID identifying unit 402 obtains, from the storage unit404, a first job ID corresponding to the first form. Then, the job-IDidentifying unit 402 generates second job IDs of the same number as theabove number of deliverables that are obtained from the givendeliverable.

The color-code image generating unit 403 generates color code data,based on second jobs generated by the job-ID identifying unit 402, wherethe color data conveys a color code indicating a color code IDcorresponding to a given second job ID, and the color code is expressedby a plurality of colors.

The storage unit 404 stores work process data received by the firstreceiving unit 401; the number of deliverables received by the firstreceiving unit 401; the first job IDs identified by the job-IDidentifying unit 402; the second job IDs generated by the job-IDidentifying unit 402; first color code data; and second color code data,to be associated with each other.

FIG. 23 is a diagram illustrating an example of a table in the storageunit, the table storing associated various pieces of information. Thetable T3 stores the number of deliverables that are obtained from agiven deliverable, as well as the information stored in the table T1.For example, for the work process of “printing” associated with thesecond job ID “A-01”, the “completion/2” in “status of workprocess/number of pieces obtained from a deliverable” indicates that theprinting process is completed and that the number of pieces obtainedfrom a given deliverable is “2”. In this case, as an example, the firstreceiving unit 401 receives the number of deliverables obtained from agiven deliverable being “2”, through an operation by the worker, whenthe printing process is completed or a given process is not completed,etc.

The image-data generating unit 405 generates third image data based onthe first image data and the second color code data.

The image obtaining unit 406 obtains an image or a movie, from eachcamera 18.

The color-code extracting unit 407 extracts the second color code datafrom the color code image 811 on the third form that is represented bythe image or the movie.

The specifying unit 408 specifies a given second job ID with referenceto the storage unit 404, based on each second color code data extractedby the color-code extracting unit 407. The specifying unit 408 alsoobtains the number of deliverables that are obtained from a givendeliverable and that corresponds to identified second job IDs, withreference to the storage unit 404. Further, the specifying unit 408determines the status of the work process for each second job ID, basedon a given second job ID, the number of deliverables that are obtainedfrom a given deliverable, and the status of the work process associatedwith the camera 18 that photographs the color code image 811.

For example, when the number of pieces of second color code data issmaller than the number of deliverables that are obtained from a givendeliverable and that is stored in the storage unit 404, the specifyingunit 408 determines that the printing process is not completed, wherethe number of pieces of second color code data is extracted from imagedata captured by the camera 18 b 1 installed in “intermediate storagelocation 1”, by the color-code extracting unit 407.

In contrast, when the number of pieces of second color code data is thesame as the number of deliverables that are obtained from a givendeliverable and that is stored in the storage unit 404, the specifyingunit 408 determines that the printing process is completed, where thenumber of pieces of second color code data is extracted from image datacaptured by the camera 18 b 1 installed in “intermediate storagelocation 1”, by the color-code extracting unit 407.

When the storage unit 404 stores a condition for determining the statusof the work process in accordance with the number of deliverables thatare obtained from a given deliverable, the specifying unit 408 maydetermine the status of the work process (e.g., the work process will becompleted soon, or it takes time to complete the work process, etc.),based on the condition.

For example, a case will be described using the condition in which thework process is determined to be completed soon and in which the numberof pieces of second color code data is 3.

In this case, when the number of pieces of second color code data issmaller than 3, the specifying unit 408 determines that the printingprocess is not completed, where the number of pieces of second colorcode data is extracted from image data captured by the camera 18 b 1installed in “intermediate storage location 1”, by the color-codeextracting unit 407.

When the number of pieces of second color code data is “3” that issmaller than the number (e.g., “5”) of deliverables that are obtainedfrom a given deliverable, the specifying unit 408 determines that theprinting process will be completed soon, where the number of pieces ofsecond color code data is extracted from image data captured by thecamera 18 b 1 installed in “intermediate storage location 1”, by thecolor-code extracting unit 407.

When the number of pieces of second color code data is “4” that issmaller than the number (e.g., “5”) of deliverables that are obtainedfrom a given deliverable, the specifying unit 408 determines that theprinting process will be completed soon, where the number of pieces ofsecond color code data is extracted from image data captured by thecamera 18 b 1 installed in “intermediate storage location 1”, by thecolor-code extracting unit 407.

When the number of pieces of second color code data is “5” that is thesame as the number (e.g., “5”) of deliverables that are obtained from agiven deliverable, the specifying unit 408 determines that the printingprocess is completed, where the number of pieces of second color codedata is extracted from image data captured by the camera 18 b 1installed in “intermediate storage location 1”, by the color-codeextracting unit 407.

As described above, the specifying unit 408 can determine the status ofthe work process in accordance with the number of pieces of second colorcode data extracted by the color-code extracting unit 407. Thereby, moredetailed information can be presented to the worker.

The second receiving unit 2001 receives the number of deliverables thatare obtained from a given deliverable in the first work process, throughan input device of the information processing terminal.

The output unit 2002 outputs the number of deliverables obtained from agiven deliverable, to the first receiving unit 401, the number beingreceived by the second receiving unit 2001.

The first display controller 2003 receives a determination result at thespecifying unit 408 to control for displaying the determination resulton a display device.

The second display controller 2004 receives a determination result atthe specifying unit 408 to control for displaying the determinationresult on a display device.

FIG. 24 is an example of a screen displayed by a display device 1902.The screen as illustrated in the example in FIG. 24 is displayed by thedisplay device 502 as an example of a displaying unit. In theillustrated screen, the “●” and “◯” are examples of visual informationand each indicate the location of a given deliverable corresponding tothe first form or the second form. In FIG. 24, a plurality of first jobIDs, as well as second job IDs derived from one or more first job IDs,are indicated in an area 2101 expressing an area within the printingplant. For example, each symbol “●” relates to “job A” corresponding tothe first job ID of “A”, and each symbol “◯” relates to “job B”corresponding to the first job ID of “B”.

When the specifying unit 408 determines that second deliverables (e.g.,deliverables managed using respective second job IDs of “B-01” and“B-02”, etc.) for “job B” are all present in an area 2102 being astorage place, and that the work process for “job A” is completed (e.g.,the printing process is completed), each of the first display controller2003 and the second display controller 2004 may change the color of thesymbols “◯” about “B-01” and “B-02”, from white to green or the like toindicate the statuses of the work processes to the worker.

Alternatively, each of the first display controller 2003 and the seconddisplay controller 2004 may display the message “printing process forjob B is completed,” as illustrated in FIG. 25, instead of changing thecolor of visual information.

FIG. 25 is a diagram illustrating a first example of a displayedmessage. In the example in FIG. 25, the message is displayed in a regionon one side of a screen. Note that the manner of displaying the messageis not limited to the illustrated example.

When the specifying unit 408 determines that second deliverables (e.g.,deliverables managed using respective second job IDs of “B-01” and“B-02”, etc.) for “job B” are all present in the area 2102 being astorage place, and that the work process for “job A” is not completed(e.g., the printing process is not completed), each of the first displaycontroller 2003 and the second display controller 2004 may change thecolor of the symbols “0” about “B-01” and “B-02”, from white to yellowor the like to indicate the statuses of the work processes to theworker.

Alternatively, each of the first display controller 2003 and the seconddisplay controller 2004 may display the message “printing process forjob B is not completed,” as illustrated in FIG. 26, instead of changingthe color of visual information.

FIG. 26 is a diagram illustrating a second example of a displayedmessage. In the example in FIG. 26, the message is displayed in a regionon one side of a screen, as is the case with the first example.

The above colors or the messages are not limited to the examplesdescribed above, and may be set in advance to indicate the status of thework process. For example, the color may be blue when the work processis completed, or the color may be red when the work process is notcompleted. Further, the message may convey the job status. For example,as illustrated in FIG. 27, in the area 2102 being the storage place, thenumber of second deliverables to be obtained until the work process iscompleted, or a message indicating that the number of seconddeliverables to be obtained until the work process is completed may bedisplayed.

FIG. 27 is a diagram illustrating a third example of a displayedmessage. In the example in FIG. 27, the message indicating that thenumber of remaining second deliverables, in the area 2102 being thestorage place, to be obtained until the work process is completed isdisplayed in a region on one side of a screen.

As described above, a notification is indicated to the worker by atleast one of the first display controller 2003 and the second displaycontroller 2004. Thereby, the worker can know when to start working andefficiently manage the work processes.

Fourth Embodiment

The first embodiment, the second embodiment, and the third embodimenthave been described using a technique achieved through the workinstructions 810 for the information processing system 12, the workinstructions 810 being instructions in which a new code (color codeimage 811) is added to the work instructions 800 for the customer system10. Such a technique can be applied to transport systems such as AGV(Automated Transport Vehicle).

For example, in a transporting system for transporting deliverables, thework instructions 810 for the information processing system 12 to whichthe color code image 811 is added are affixed to a given article, and atransported article is photographed by the camera 18. Thereby, the workprocesses of the articles transported by one or more transportingdevices can be managed. Also, locations of the transporting devices eachtransporting the articles, as well as destinations of the articles, canbe identified. Thereby, the transporting system can also manage themovement of a given article transported by the transporting devices.

Fifth Embodiment

The first embodiment, the second embodiment, and the like have beendescribed for the management of the work processes for jobs in theprinting plant, but may also be applied to the management of the workprocesses of articles conveyed by one or more belt conveyors, forexample. For example, the technique described in the embodiments isapplied to the management of the work processes of articles conveyed byone or more belt conveyors. In this case, a given article conveyed byone or more belt conveyors can be tracked and thus one or more conveyorbranching devices can be also controlled.

The present disclosure is not limited to the embodiments specificallydisclosed, and various modifications and changes can be made withoutdeparting from a scope of the claims.

What is claimed is:
 1. An information processing system comprising: aplurality of imaging devices; and an information processing deviceincluding circuitry configured to: receive work process data indicatingitems of multiple work processes; a first image of a first formincluding first job ID information; and information indicating thatmultiple pieces are obtained from a first deliverable corresponding tothe first form, in a first work process from among the multiple workprocesses; generate a second job ID in which distinguishing informationis added to a first job ID; generate second color code data based on thesecond job ID; store the second color code data, the first job ID, thesecond job ID, and the work process data to be associated with eachother; generate second image data based on the second color code dataand the second job ID, the second image data indicating a second formdifferent from the first form; obtain image data and identificationinformation of a given imaging device from among the plurality ofimaging devices, the image data being generated based on the generatedsecond image data of the second form that the given imaging devicephotographs, the second form being disposed on a recording medium;extract the second color code data from the image data obtained by thecircuitry; and specify a status of a given work process from among themultiple work processes, based on the identification information; thesecond color code data extracted by the circuitry; the second color codedata stored in the circuitry; the second job ID stored in the circuitry;and the work process data.
 2. The information processing systemaccording to claim 1, wherein the circuitry is configured to store thestatus of a given work process, for each imaging device.
 3. Theinformation processing system according to claim 2, wherein thecircuitry is configured to receive a number of pieces that are obtainedfrom the first deliverable corresponding to the first form, in the firstwork process, wherein the circuitry is configured to store a number ofpieces, the second color code data, one or more second job IDs, and thework process data to be associated with each other, wherein thecircuitry is configured to determine whether a second work processfollowing the first work process can be initiated, based on the storednumber of pieces; image information obtained from a given imagingdevice; the second color code data extracted by the circuitry; thesecond color code data stored in the circuitry; the first job ID storedin the circuitry; and each second job ID stored in the circuitry.
 4. Theinformation processing system according to claim 3, wherein thecircuitry is configured to extract pieces of second color code data thatare generated in accordance with the extracted number of pieces that areobtained from the first deliverable corresponding to the first form, inthe first work process, and wherein the circuitry is configured todetermine that the second work process can be initiated upon determiningthat the extracted number of pieces of second color code data is same asthe number of pieces that are obtained from the first deliverable. 5.The information processing system according to claim 3, wherein thecircuitry is configured to output, to an information processingterminal, a number of deliverables to be obtained until the second workprocess is initiated, based on image information from a given imagingdevice; the extracted first color code data or the extracted secondcolor code data; the stored first color code data or the stored secondcolor code data; and the stored first job ID or each second job IDstored in the circuitry.
 6. The information processing system accordingto claim 1, further comprising an information processing terminalincluding a display controller configured to receive a determinationfrom the circuitry to control a display unit, the determination beingperformed by the circuitry that determines a location of a given firstform or a given second form based on the image data captured by a givenimaging device, wherein the display controller is configured to: causethe display unit to display an image expressing a storage where one ormore deliverables obtained in the first work process are stored; andcause the display unit to display, based on the determination, visualinformation indicating the location of the given first form or the givensecond form, on the image expressing the storage.
 7. The informationprocessing system according to claim 4, further comprising aninformation processing terminal including a display controllerconfigured to receive a determination from the circuitry to control adisplay unit, the determination being performed by the circuitry thatdetermines a location of a given first form or a given second form basedon the image data captured by a given imaging device, wherein thedisplay controller is configured to: cause the display unit to displayan image expressing a storage where one or more deliverables obtained inthe first work process are stored; cause the display unit to display,based on the determination, visual information indicating the locationof the given first form or the given second form, on the imageexpressing the storage; and cause the display unit to display, based onthe determination, information indicating that the second work processcan be initiated.
 8. The information processing system according toclaim 4, further comprising an information processing terminal includinga display controller configured to receive a determination from thecircuitry to control a display unit, the determination being performedby the circuitry that determines a location of a given first form or agiven second form based on the image data captured by a given imagingdevice, wherein the display controller is configured to: cause thedisplay unit to display an image expressing a storage where one or moredeliverables obtained in the first work process are stored; cause thedisplay unit to display, based on the determination, visual informationindicating the location of the given first form or the given secondform, on the image expressing the storage; and cause the display unit todisplay, based on the number of pieces, a number of deliverables to beobtained until the second work process is initiated, the deliverablescorresponding to the first form or second forms.